NRL/FR/5341--93.9524 


New  Results  in  Signal  Design 
For  the  AWGN  Channel 


Michael  J.  Steiner 


Target  Characteristics  Branch 
Radar  Division 


January  3i,  1993 


33-04968 

I 


lliiil 


Approved  for  public  release;  distribution  unlimited. 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

0MB  No.  0704  0188 

PubUc  reporting  burden  for  this  cottection  of  informetion  ni  eatimeted  to  everage  1  hour  per  reeponee.  including  the  time  for  rev>«wing  iretrucuom,  eesrchtng  eKiet^ng  d»t«  eourcet, 
gathering  end  meinteirMnQ  the  data  needed,  erxi  completing  end  reviewing  the  collection  of  information.  Send  commenta  regarding  thia  burden  eetimate  or  any  oth^  aepect  of  ihia 
collection  of  information.  Including  auggeatione  for  reducing  thia  burden,  to  Waahtngton  Headquarters  Servicee.  Directorate  for  tnformatton  Operatione  and  Reports.  1216  Jefferson 
Oavia  Highway.  Suite  1204,  Ariirtgton,  VA  22202-4302.  arxf  to  the  Office  of  Mar>agement  and  Budget.  Paperwork  Reductior^  Piofsct  10704-01881,  Weehrngton.  OC  20603 

1 .  AGENCY  USE  ONLY  {Letve  BhnkI 

2.  REPORT  DATE 

January  31,  :>v3 

3.  REPORT  TYPE  AND  DATES  COVERED 

4.  TITLE  AND  SUBTITLE 

New  Results  in  Signal  Design  for  the  AWGN  Channel 

6.  FUNDING  NUMBERS 

PE  -  61153N 

PR  -021-05-43 

WU  -  DN480-006 

6.  AUTHOR(S) 

Michael  J.  Steiner 

7.  PERFORMING  ORGANIZATION  NAME(S)  and  ADDRESSfESI 

Naval  Research  Laboratory 

Washington.  DC  20375-5320 

8  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

NRL/FR/534 1-93-9524 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  AODRESSIESI 

Office  of  Chief  of  Naval  Research 

Arlington.  VA  22217-5000 

10.  SPONSORING/MONITORING 
AGENCY  REPORT  NUMBER 

1 1 .  SUPPLEMENTARY  NOTES 

1 2a.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited. 

12b.  DISTRIBUTION  CODt 

1 3.  ABSTRACT  ^Maximum  200  wordsl 

The  design  of  M  average  power  constrained  signals  in  white  Gaussian  noise  (AWGN)  is  addressed.  The  long-standing  strong 
simplex  conjecture  which  postulates  that  the  optimal  signals,  under  an  average  power  constraint,  are  the  vertices  of  a  regular  simplex, 
is  disproven.  A  signal  set  is  shown  that  performs  better  than  the  regular  simplex  at  low  signal-lo-noise  ratios  for  all  M  ^  7.  This 
leads  to  a  theorem  stating  that  for  any  fixed  M  a  7  no  signal  set  exists  that  is  optimal  al  all  signal-lo-noise  ratios.  Furthermore  it  is 
found  that  the  optimal  solution  at  low  signal-to-noise  ratios  is  not  an  equal  energy  solution  for  any  M  &  7.  The  regular  simplex  is 
shown  to  be  the  unique  polytope  that  maximizes  the  minimum  distance  between  signals.  This  result  leads  to  the  corollary  that  a 
signal  set  which  maximizes  the  minimum  distance  is  not  necessarily  optimum.  However,  the  regular  simplex  is  shown  to  be  globally 
optimum  in  the  sense  of  uniquely  maximizing  the  union  bound  at  all  signal-to-noisc  ratios. 

14.  SUBJECT  TERMS 

Signal  design  White  Gaussian  noise 

Simplex  conjecture  M-ary  communication 

15  NUMBER  OF  PAGES 

28 

16.  PRICE  CODE 

17.  SECURITY  CLASSIFICATION 

OF  REPORT 

UNCLASSIFIED 

18.  SECURITY  CLASSIFICATION 

OF  THIS  PAGE 

UNCLASSIFIED 

— 

19,  SECURITY  CLASSIFICATION 

OF  ABSTRACT 

UNCLASSIFIED 

20.  LIMITATION  OF  ABSTRACT 

SAR 

NSN  7540-01 -280-5500  St*nd*^d  Form  2fl8  {Rev.  2-80t 

PreecnM  by  ANSI  Std  238  18 


CONTENTS 


1.  INTRODUCTION .  1 

2.  PRELIMINARIES  .  3 

3.  COUNTEREXAMPLE  TO  THE  STRONG  SIMPLEX  CONJECTURE .  6 

4.  MAXIMIZATION  OF  MINIMUM  DISTANCE . 11 

5.  OPTIMALITY . 13 

6.  CONCLUSIONS  . 16 

ACKNOWLEDGMENT . 17 

REFERENCES  . 17 

APPENDIX  A  —  Representation  of  Inner  Product  Matrix . 19 

APPENDIX  B  —  Proof  of  Monotonicity . 21 

APPENDIX  C  —  Derivation  of  Bounds . 23 


iii 


Accesion  For 

NTIS  CRA&I 
OTIC  TAB 

Unannounced 

Justification 


By _ 

Distribution/ 

Availability 


Codes 


Avail  and/or 
■Special 


NEW  RESULTS  IN  SIGNAL  DESIGN  FOR  THE  AWGN  CHANNEL 


1.  INTRODUCTION 

The  design  of  efficient  signal  sets  for  transmission  over  channels  that  are  contami¬ 
nated  by  Gaussian  noise  has  been  an  active  area  of  research  for  many  years.  A  signal  set 
that  is  more  efficient  than  another  will  typically  result  in  comparable  savings  in  trans¬ 
mitted  energy.  Hence,  the  determination  of  optimal  signal  sets  is  an  important  problem 
from  a  practical  communication  perspective  as  well  as  from  a  theoretical  standpoint.  A 
fair  amount  of  work  has  been  done  in  the  area  of  signal  design.  Unfortunately,  few  results 
exist  on  the  optimality  of  signal  sets  (throughout  the  paper  an  optimal  signal  set  is  one 
that  maximizes  the  average  probability  of  detection.)  The  optimal  selection  of  M-signal 
vectors  embedded  in  even  the  most  fundamental  type  of  noise,  white  Gaussian  noise, 
generally  is  not  known.  One  of  the  most  famous  conjectures  of  communication,  dating 
back  to  1948,  states  that  the  optimal  signal  vectors  are  vertices  of  an  n  dimensional 
regular  simplex  for  which  Af  =  n  -f  1[1,  p.  74j.  When  the  signal  vectors  are  constrained 
only  by  an  average  power  limitation,  this  conjecture  is  referred  to  as  the  strong  sim¬ 
plex  conjecture  (SSC)  [2].  To  avoid  confusion,  we  refer  to  the  conjecture  of  simplex 
optimality  when  the  signal  vectors  lie  on  the  surface  of  a  sphere,  as  the  weak  simplex 
conjecture  (WSC).  The  validity  of  the  SSC  implies  the  validity  of  the  WSC,  although 
the  converse  statement  is  not  true.  Note  that,  irrespective  of  whether  or  not  the  signal 
vectors  are  average  power  constrained  or  peak  power  constrained,  the  capacity  of  the  ad¬ 
ditive  Gaussian  noise  channel  (AGNC)  is  the  same(3)(4,  p.  324].  Under  the  assumption 
that  the  signal  vectors  are  of  equal  energy,  Balakrishnan  proved,  in  his  seminal  work  {5|, 
that  the  regular  simplex  is  1)  optimal  (in  terms  of  maximizing  the  average  probability 
of  detection)  as  the  signal-to-noise  ratio  (SNR)  \  approaches  infinity,  2)  optimal  as  A 
approaches  zero,  and  3)  locally  optimal  at  all  A.  He  also  proved  that  if  a  signal  set  does 
exist  that  is  optimal  at  all  A,  it  is  necessary  the  regular  simplex  signal  set.  In  1967, 
Dunbridge  [6|  [7]  extended  Balakrishnan ’s  work  where  only  an  average  power  constraint 
is  imposed  on  the  signal  set.  Dunbridge  proved  that  the  regular  simplex  is  1)  the  optimal 
signal  set  as  A  approaches  infinity  and  2)  a  local  extremum  at  all  A.  He  also  proved  that 
the  regular  simplex  must  be  the  optimal  signal  set,  if  one  does  exist.  F'or  the  case  of 
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M  =  2,  the  regular  simplex  or  antipodal  signal  set  has  bt'en  proven  to  be  optimal  at 
all  SNR  for  both  the  average  and  peak  power  constrained  channels.  Dunbridge  proved, 
under  an  average  power  constraint,  that  the  regular  simplex  with  M  3  is  optimal  as 
A  approaches  zero.  Work  on  the  weak  simplex  conjecture  [8]  was  later  shown  by  Farber 
[9]  to  prove  the  conjecture  for  A/  <  5.  It  was  proven  by  both  Balakrishnan  [10]  and 
Weber  [11,  p.  215j  that  the  regular  simplex  maximizes  the  minimum  distance  uruk'r  a 
peak  power  constraint. 

Generally,  the  optimal  design  of  signals  for  the  noncoh(!rent  Gaussian  channel  is  also 
unknown.  It  has  been  long  conjectured  that  the  orthogonal  .signal  set  is  th('  global  (Opti¬ 
mum.  Weber  [11,  p.  269]  proved  that  the  orthogonal  signal  set  is  locally  of>timum  undc'r 
no  bandwidth  constraint.  Stone  and  Weber  [12]  further  proved  the  optimality  {)f  the  or¬ 
thogonal  signal  set  as  A  approaches  infinity.  The  orthogonal  signal  set  has  hfs^n  {jroven 
to  be  the  global  optimum  for  all  SNR  for  the  c?ise  of  M  --  2  [13j.  Cjlscs  of  restricted 
dimensionality  have  been  explored  [14]  for  two  dimen.sion.s  and  M  -  2,  3, 4, 6,  12. 

A  number  of  new  results  are  presented  in  this  paper.  The  major  result  that  is 
presented  in  Section  3  is  a  counterexample  to  the  strong  simplex  conjectun'.  An  explicit 
signal  set  is  shown  to  be  better  than  the  regular  simplex  for  all  A/  >  7  under  an  average 
power  constraint.  This  leads  to  a  proof  establishing,  for  any  A/  >  7,  that  then'  are 
no  signal  sets  that  are  optimal  at  all  signal-to-nolse  ratios.  In  Se<‘tion  4  we  provx'  that 
the  regular  simplex  uniquely  maximizes  the  minimum  distance  under  an  average  power 
constraint.  A  simple  proof  that  the  regular  sim]>lex  nniximizes  the  minimum  distance 
under  a  peak  power  constraint  is  also  shown.  This  work  leads  to  the  corjllary  that 
a  signal  set  that  maximizes  the  minimum  distance  betwwn  signals  is  \ot  necessarily 
optimum.  This  is  an  interesting  result,  since  much  signal-d('sign  work  has  been  based  on 
maximizing  the  minimum  distance  between  signals  because  of  the  inhen'iit  sim])licity  of 
the  criteria.  In  Section  5  we  address  the  global  optimality  of  the  regular  simplex  under 
the  performance  measure  of  the  union  bound  on  the  probability  of  detection.  The  union 
bound  is  often  used  to  assess  the  performance  of  signal  set  s  at  medium  to  high  SNH  when 
computation  of  the  probability  of  detection  is  intractable.  It  is  proven  that  the  n'gtilar 
.simplex  uniquely  maximizes  the  union  bound  at  all  SNR.  Th<'  ojttimality  of  signal  sets 
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at  low  signal-to-noise  ratios  is  also  examined.  It  is  proven  that  the  optimal  solution  at 
low  signal-to-noise  ratios  is  not  an  equal  energy  solution  for  all  M  >  7.  Additionally  the 
signal  set  presented  in  Section  3  is  shown  to  be  the  optimal  signal  set  when  restricted 
to  all  1-D  signal  sets. 

2.  PRELIMINARIES 


Consider  the  transmission  of  one  of  M  signals  s,(<),  i  ~  I,  •  ■  ■ ,  A/  through  a  channel 
contaminated  with  white  Gaussian  noise  n{t).  I’he  signals  can  be  represented  through 
a  discrete  time  n  dimensional  vector  representation  (the  time  discretization  of  a  con¬ 
tinuous  time  signal  is  discussed  at  length  in  Ref.fll,  p.  127]).  After  transmission  we 
receive  the  n  dimensional  vector 

y  =  Sj  -t-n  i~  (1) 


and  wish  to  determine  which  of  the  M  signals  was  transmitted.  We  define  the  SNR 
parameter 


M 


M 


Esfs. 


(2) 


where  T  denotes  transpose.  It  is  assumed  that  n  is  a  zero  mean  Gaussian  vector  with 
covariance  matrix  equal  to  the  n  by  n  identity  matrix.  We  define  the  normalized  M 
dimensional  matrix  of  inner  products  a  =  {Xij)  by, 


It  immediately  follows  that 

M 

(^) 

i=l 

For  an  equal  energy  signal  set,  the  A,i,  i  =  1,  •  •  • ,  A/  are  identical. 

The  optimum  detector,  in  terms  of  maximizing  the  average  probability  of  detection, 
chooses  that  signal  Sj,  which  maximizes  p(y|si)pi,  where  the  a  priori  probability  of  the 
iih  signal  is  pi  and  p{y|Si)  is  the  probability  density  function  of  y  conditioned  on  Sj. 
The  results  derived  throughout  the  paper  will  assume  that  the  signals  are  equally  likely, 
i.e.,  Pi  ~  -jg.  In  ca.se  of  ties,  we  choose  the  signal  with  the  smallest  index  from  the  s, 
that  tied.  We  can  write  p(y|Si)pi  as, 


P(y|Si)p.  = 


Si)^{y-Si)  +  iogp,|. 


(4) 
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T 

Upon  defining  Ei{y)  =  +  logp,,  we  see  that  Eq.  (4)  is  nuiximized  when  we 

choose  the  signal  corresponding  to  the  maximum  of  /w{y).  The  average  probability  of 
detection  is, 


=  IIP.F(F,(y)  =  maxE^(y)lSj) 

i  ^ 

^  YiPi  J  P(y|Si)(fpi  ■■■dy„ 


1 


J  'Im  +  Fi(y)](ip,  ■  •  •  dijn, 


Y  {27r)«F 

where  A,  corresponds  to  the  decision  region  {y|F,(y)  =  maxj  Fj(y)}  for  cases  where  a 
unique  maximum  of  Ej{y)  for  j  =  1,  -  •  • ,  A/  exists.  When  a  unique  maximum  does  not 
exist,  we  resolve  ties  by  choosing  the  signal  index  from  the  smallest  index  among  those 
regions  {y|Fi(y)  =  maxj  Ej{y)}  that  overlap.  When  defined  in  this  manner  the  A,  are 
disjoint,  and  the  above  can  be  rewritten  as 


=  7n  ^n72  f  Fi(y})dyi  •  ■  •  dy„,  (5) 

where  Rn  represents  n-dimensional  Euclidean  space.  This  equation  can  he  examined 
by  defining  a  n-dimensional  Gaussian  vector  z  with  zero  mean  and  identity  covariance 
matrix.  The  equation  then  becomes 

Fd  =  E(exp[max  Fj(z)]),  (6) 

where  Ei{z)  is  Gaussian  distributed  with  moments 

E(Fi{z))  = 

Cov(Ei(2),Fj(z))  =  sjsj  =  AijA^. 


Note  that  the  probability  of  detection  in  Eq.  (6)  is  only  a  function  of  the  SNR  A,  the 
normalized  matrix  of  inner  products  a,  and  the  a  priori  signal  probabilities  pi.  This  is 
because  the  Gaussian  distribution  is  completely  specified  in  terms  of  its  first  and  s('cond 
moments.  Since  a  is  invariant  under  orthogonal  transformations  imjmsed  on  the  signal 
vectors,  the  probability  of  detection  is  invariant  under  any  orthogonal  transformation 
of  the  signal  vectors.  It  is  known  that  the  inner  product  matrix  or  Gram  matrix  of  the 
signal  vectors  is  positive  semidefinile  [15,  p.  407j.  The  following  lemma  is  important  to 
the  forthcoming  development; 
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Lemma  1  -  Every  ianer  product  matrix  uniquely  specifies  a  signal  set-up  to  a  geometric 
isometry. 

The  proof  is  shown  in  Appendix  A,  This  lemma  shows  that  signal  sets  may  be  represented 
in  terms  of  their  inner  product  matrices.  Hence,  we  define  the  admissible  inner  product 
matrices  A  to  be  those  inner  product  matrices  that  are  positive  semidefinite  and  satisfy 
the  average  power  constraint  in  Eq.  (3).  It  is  seen  that  A  is  a  compact  convex  set.  The 
boundary  of  A  is  the  set  of  inner  product  matrices  in  A  w'ith  determinant  identically 
zero.  The  interior  is  the  set  of  inner  product  matrices  in  A  with  determinant  greater 
than  zero.  Since  A  is  compact,  and  the  probability  of  detection  is  a  continuous  function 
of  a  [10],  it  follows  that  the  vector  a,  w’hich  maximizes  the  probability  of  detection,  is 
found  in  A.  It  is  shown  in  Ref.  [7,  p.  63)  that  a  neces.sary  condition  for  optimality  is 
that  the  sum  of  the  signal  vectors  is  identically  zero.  An  equivalence  of  --  0  is  [7, 

p.  66] 

M  M 

P) 


Another  equivalence  is 

M 

(8) 

i=l 

Equation  (7)  specifies  a  hyperplane  that  contains  nonadmissible  as  well  as  admissible  q. 
The  intersection  of  the  hyperplane  with  A  contains  the  optimal  a. 

A  partial  ordering  of  A  can  be  found  as  follows.  Let  two  inner  product  matrices 
a  and  a'  have  the  same  diagonal  elements.  If  AL  <  A,^  for  all  i  /  j  then  Prf(A.(t')  > 
Pd{X,oi).  This  follows,  since  the  derivative  of  the  detection  probability  with  respect  to 
each  Xij  i  ^  j  is  nonpositive  [7,  p.  68). 

Definition  1  —  {si ,  •  •  • ,  s,v/ }  is  a  regular  simplex  if  each  s, .  i  1 ,  •  ■  ■ ,  M  is  at  the  smru: 
distance  from  each  Sj,  j  -  I,---,  A/  where  i  /  j.  If  additionally  E,s,  0.  the  regular 
simplex  is  a  regular  simplex  signal  set. 

The  regular  simplex  signal  set  can  be  specified  in  terms  of  the  inner  product,  matrix  l)y 
the  relations, 

Xii  “  1 ,  i  “  I ,  •  •  • ,  M 


(9) 
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The  probability  of  detection  of  the  simplex  Pd,  is  given  by  Ref.  |1 1,  p.  I62j 

Pd,  =  -4=  exp[-  (x)dT  M  >  2  (10) 

\/27r  J-oo  2 

where 

A  necessary  condition  for  optimality  at  low  SNR  is  that  the  mean  width  of  the  polylope 
generated  by  the  signal  set  be  a  maximum.  This  is  true  for  both  the  average  power 
constrained  case  [6]  and  the  peak  power  constrained  case  [5].  The  polylope  of  a  set  of 
signal  vectors  {Sj}  is  the  convex  hull, 

{y|y  =  I]l7.s„  =  7.>0,  2- A/}. 

i  i 

The  mean  width  B  is  defined  as 

B=f  m^yjsi  d/i(y„),  (12) 

Jn„  » 

where  0„  is  the  surface  of  an  n  dimensional  unit  sphere,  yn  is  a  unit  vector  representing 
a  point  on  ri„,  and  MiYn)  is  a  uniform  probability  measure  over  n„  as  a  function  of  y„. 

3.  COUNTEREXAMPLE  TO  THE  STRONG  SIMPLEX  CONJECTURE 


An  explicit  signal  set  is  presented  that  has  a  probability  of  detection  greater  than 
the  regular  simplex  signal  set.  Consider  placing  M  —  2  signals  at  the  origin,  and  placing 
the  remaining  two  vectors  in  a  manner  such  that  they  form  an  antipodal  signal  set  as 
in  Fig.  1.  (Two  equal  length  vectors  Si  and  S2  are  defined  to  be  antipodal  whenever 
sfs2  =  — l|si|j  [is2||  where  j|  ■  j|  represents  the  Euclide  in  or  L2  norm)  .  We  will  refer  to 
this  signal  set  as  the  low'  SNR  1-D  .signal  set  (LI).  Figure  I  .shows  tlie  distance  c  from 
the  origin  to  Si  or  S2,  whic'h  is  determined  by  Eep  (2).  thus  yic;lding  r  --  '^\/^'  Wlien  the 
signals  are  equally  likely,  it  is  easily  seen  from  Eq.  (4)  that  the  optimal  detector  chooses 
the  signal  that  is  closest  in  Euclidean  distance  to  the  received  signal.  We  defim'  the 
decision  regions  Aj  such  that  if  y  €  Aj  we  choose  s^.  The  decision  rc-gions  are  shown  in 
Fig.  1.  If  y  €  A^  =  {A3,  •  •  • ,  Aw}  any  Si,  i  E  (3,  ■  •  • ,  A/}  can  be  chosen.  For  simplicity, 
we  will  assume  that  if  y  G  A^  then  S3  is  chosen.  Denoting  Pd^  as  the  probability  of 
detection  of  signal  Sj,  we  can  compute  the  average  probability  of  detection  of  the  LI 
signal  set  as. 
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Now  by  symmetry  =  Pdi  and 

Pdi  =  #’(yeA,|s,) 

=  •i>(|)  (14) 

where  $(x)  is  defined  in  Eq.  (11).  It  is  seen  that  ^d4  —  •  •  •  —  Pdf^  —  0  and  denoting 
^  e  {si, S2,  •  •  • , Say}  as  the  decision  that  is  made  regarding  which  signal  is  sent,  we  have 

Pd,  =  P{6  =  sgjsa) 

=  P{6  -  saly  €  ^^,s■3)P(y  e  +  P{6  =  Saly  G  aF.S3)P(AF|s3} 

=  2$(|)-1  (M>3).  (15) 

Now  the  average  probability  of  detection  can  be  computed  as 

=  ^(44>(^\/f)-l|  (A/ >3).  (16) 

Proposition  1  —  Neighborhoods  X  G  (0,^^/);  >  0  of  X,  exist  where,  Pd,,{X)  IS 

strictly  greater  than  Pd.iX)  for  all  M  >7  and  less  than  Pd.W  —  6- 
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Proof;  Assume  M  is  fixed.  Since  both  and  P.i,  /"a, (A,  .A/)  are 

differentiable  with  respect  to  A  on  A  e  [0,  oo)  and  -  Pd.  1  -  ig  at  A  0  it  is 
sufficient  [16,  p.  209]  to  prove  that 


Now 


Pi  (0  ¥)  ~ 


> 


dPd.iX^M) 


d\ 


AO 


(17) 


4  a<t.(|v®) 
M 


dX 


x-o 


M 


dX 


A:;^0 


VMtt 


{M  >  3). 


(18) 


Since  the  integrand  of  Eq.  (10)  is  differentiable  with  respect  to  A  on  A  e  [0,  oo),  and  the 
derivative 


M 


M  -  1 


(x  -  X 


is  integrable,  it  follows  from  Ref.  [17,  p.215)  that  the  order  of  differentiation  and  inte¬ 
gration  can  be  reversed.  Hence, 


P'M  M)  = 


_  dPd. 


dX 


M 


x=o 


27r(M 


—  f  a:exp[-^l<l>''^  \x)dx. 
1 }  J  —  OC  2 


(19) 


Since  the  integrand  in  Eq.  (19)  is  negative  for  x  <  0  it  follows  that, 


<  VyK  f  (20) 

For  large  M,  the  function  resembles  a  step  function,  with  the  location  of  tlx' 

step  increasing  in  M.  The  location  of  the  step  hicreases  slow'ly  with  M.  we  will 
approximate  the  location  of  the  step  by  clog(A/  —  1)  and  upper  bound  Ecj.  (20)  by 


p:(o,m)  < 


M 


M  ~  1 


L 


c  log( M-l] 


clog(A/-  i) 


‘(;r)(/x  f 


r 

J r  log(  i 


X- 


.'Xpj 


/-I) 


\/27r 


-<li 


where  c  >  0  is  a  constant  to  be  optimized  later,  and  log  repre.sinits  the  natural  logarithm. 
Both  terms  above  can  be  directly  integrated  yielding. 
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P'MM)  < 


/  M 

C  1( 

V  Af  -  1 

cl( 

'  V  -1 

clog^./f  - 

1) 

c:Iog(A/  -  i) 


1 


expl- 


(ciogjAf -1))^ 
2 


c\og{M  -  1)  expllog({A/  -  l)-5) log{(A/  ~  1 )'  )! 


M 


ciogy./y  -  i)  ^  I  in  .  I _ 

y/M{M  -  1}  V  27r(A/  -  1 )  ^  y/M  -  1 


\j2z 


1ok(  ’if  -  1 ) 


Y  * 


(21) 


We  want  to  determine  when  P'n  >  P'  or  eciiiivalenlly  when  r  =  P'J P'n  <  1-  hVorn  Hcj. 
(21)  and  Eq.  (18) 

clog(M-t)  ,  /  M  '(  1  V_-^  I<1I>;(A/-1) 

V  27r(A/--i)V'A/-r 

r  <  - - r- - 


•J  Mir 


■v/ffc 


log(M  -  1) 


+ 


M 


y/M  -  1  ^2{M  -  ij  v/A/  -  1 


- /i(A/,c).  (22) 


For  each  M  define 

Cm  —  a.vgmm  h{M,c).  (23) 

We  would  like  to  determine  Cm  in  order  to  find  the  smallest  A/  such  that  P’J  P^^  <  1 .  By 
using  an  available  minimization  routine,  we  found  C30  =  -78  for  M  ~  30  and  /i(3(),  .78)  ■ 
.9896,  To  prove  r  <  1  for  all  A/  >  30  in  Appendix  B  it  is  shown  that  h{APc)  is  a 
monotonically  decreasing  function  of  M  for  all  A/  >  30. 

The  bound  of  Eq.  (22)  is  not  tight  enough  for  the  cases  of  M  <  30.  In  Appendix  C, 
a  tighter  upper  bound  is  derived  that  is  shown  by  Eq.  (37)  as 


r  < 


TT 


(Af  -  1)  ^  k 


4^-1  4 

-rE*  ('r)  +4<1> 


A/ 


(4)1  + 


M 


1=0 


v/2(Af  -  1) 


exp[— 8j, 


(24) 


where  the  bound  improves  as  the  positive  integer  k  increases.  To  evaluate  rigorously  an 
upper  bound  on  r,  we  carry  only  five  decimal  places  throughout  any  mvltiplication  and 
round  up  or  down  the  fifth  decimal  place  as  appropriate  to  upper  bound  r.  We  define 
ti  as  the  evaluation  in  this  manner  of  Yiilo  ‘h^^(?|),  and  t2  as  the  evaluation  of  ‘h''^'(4). 
We  therefore  upper  bound  Eq.  (24)  by 


r  <  UM)  = 


TT  4  A/ 

(Af  -  \)^  k^^^  ^  y2(Ar 


1) 


expf-8]. 


(25) 


We  have  computed  ti  and  <2  by  lower  and  upper  bouruling  <f>  functions  for  given  from 
a  table  of  the  function  to  five  decimal  places  [18j.  I'he  results  can  be  verified  and  are 
shown  in  Table  1.  This  proves  the  result  for  7  <  A/  <  00. 
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Now  we  proceed  to  lower  l)ound  r  for  M  I'lie  r<->i,iiliir  siiiijih  x  |)iuv(  n 

to  he  optimal  for  M  3  [(ij  at  low  sigiial-to-noise  ratios.  In  Apjn-ndix  ( the  ti^lit  lower 
bonnd  of  hq.  (3S)  is  dt'rived 


4, (■'?-!)(_ 


V  (A/  -  1)  [  ^  k’  k  ^  ^ 


exp|~S|<{' 


A^ain.  we  will  carry  five  decimal  places  throughout  tlie  ('valuation,  rounding  up  or  down 
appropriately  to  further  lower  hound  r.  We  define  ;us  th<'  evaluation  in  this  inaniK-r 


/2(A/-1) 


,j,(M--»(_l)exp[-ij  - 


evaluation  of  Yli~\  f/;?  <  and  as  the  evaluation  of  ’'(A).  In  'I'ahlc 

2  the  lower  bound  is  tabulated. 


r  >  =  q^  4 


77  [-4  k-\ 

jrrT)  T’O  -t— fl. 


>xpj-Kjr/,i. 


Again,  the  values  of  the  4>  function  were  taken  from  Ref.  [18j.  In  tht'  computation  of  f/i. 

and  <^(-.05^)  the  values  were  rounded  up  to  the  fifth  (k'cimal  j)lace.  and  <h{-l) 
was  rounded  down.  <72  result  of  rounding  up.  and  q^  and  f/i  an'  the  results  of 

rounding  down.  In  the  case  of  A/  -  5,  k  was  found  to  be  too  Iarg('  for  the  use  of  th(> 
table,  so  in  this  case  an  approximation  from  Ref.  jlf).  F.q.  26.2.175  was  u.sed.  which  has 
an  error  <  T.o- 10"*,  and  when'  vve  rounded  the  fifth  decimal  place  uj)  or  down  as  Ix'fore, 
rims  the  proposition  is  proven. 

This  result,  apart  from  being  a  count erexamjdt'  to  th('  SSC,  leads  to  an  import.uit 
theorem. 


Theorem  1  For  any  Jixal  M  >  7  fhrrr.  if;  no  siynal  set  that  is  optimal  ai  all  signal- 
to-noise  ratios. 


IToof:  'File  proof  follows  from  the  proposition  and  Thi'orem  14  in  Ref.  |6|  that  estab¬ 
lished  that  the  regular  simplex  is  the  only  signal  structure  lliat  is  a  local  (‘xtremum  at 
all  A  >  0. 
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4.  MAXIMIZATION  OF  MINIMUM  DISTANCE 

The  normalized  distance  dij,  between  Sj  and  Sj,  is  the  Kuclidean  distance  divided  by 
A.  We  define  the  normalized  minimum  distance  dmm,  as  the  minimum  Euclidean  distance 
divided  by  the  SNR  A.  Maximization  of  minimum  Euclidean  distance  is  equivalent  to 
maximization  of  dmin-  It  was  proven  by  both  Balakrislman  (lOj  and  Weber  jll,  p.  215] 
that  the  regular  simplex  uniquely  maximizes  the  minimum  distance  undt'r  a  peak  power 
constraint  Xu  =  1,  i  =  1,  •  •  • ,  M.  Here  a  new  shortened  proof  of  this  is  given.  Note  that 
maximizing  the  minimum  distance  for  the  peak  power  constrained  channel  is  equivalent 
to  minimizing  max,yj  Aq. 


Theorem  2  —  The  regular  simplex  is  the  unique  signal  set  that  maximizes  the  minimum 
distance  between  the  signal  vectors  under  a  peak  power  constraint  Xu  1 ,  z  1,  •  ■  •  •  XI . 


Proof:  The  minimum  value  of  maxjj^j  Aq  is  —  since  for  any  signal  set  q 


implies  that  [11,  p.  215], 


i  }>i 


M 

2 


(28) 


Denoting  the  matrix  of  inner  products  of  the  regular  simplex  as  Oj,  any  other  matrix 
a'  ^  a,  that  satisfies  maxi^j  A(j  =  ~'MZi  *Titist  have  at  least  one  Aq  strictly  less  than 
~  which  violates  Eq.  (28).  Therefore  a'  —  a^. 

Now  we  will  generalize  this  result  to  the  case  w'here  the  signal  vectors  are  only- 
constrained  by  'EiXii  =  M.  The  difficulty  found  in  solving  this  problem  as  opposed  to 
the  prior  problem  is  that  the  distance  between  the  signal  vectors  s,  and  s_,  no  longer 
depends  only  on  the  inner  product  Aq,  i  j-  The  lemmas  that  follow  will  help  to 
overcome  this  difficulty. 


Lemma  2  —  A  signal  set  with  Ei  Xu  —■  M  maximizes  the  minimum  distance  dmm  if 
and  only  if  for  all  iff. 

Proof:  It  can  be  seen  that 


X^X^^q  -  XI XI “  2Aq  (29) 

i  }>i  i  j>i 
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and  by  Eq.  (28) 


hi 


ij  I  i  ]>i 


m 

•  j>« 

Since  have  <  M‘‘  or  with  equality 

if  and  only  if  dij  —  d^„in  for  all  i  /  j.  I'he  latter  condition  is  satisfied  by  th('  regular 
simplex  signal  set. 

Now,  we  only  need  to  prove  that  the  regular  simplex  is  the  unique  signal  structure 
that  maximizes  dmin>  since  we  know  from  above  that  it  is  a  signal  structure  that  nuixi- 
mizes  dmin-  Note  that  translations  of  a  signal  set  result  in  the  same  distanc-es  bi'twixui 
signal  vectors. 


Lemma  3  — A  necessary  condition  for  maximizing  the  minimum  distance  is  0- 


Proof;  Suppose  HjSj  0  and  assume  (w.l.o.g.)  d,nin  >  0.  Consider  the  translation 
V  s 

/  —  s'  =  Sj  +  /  which  implies  12^  s'  =  0.  By  our  earlier  remark,  d,n,n- 

Now, 

i  i 

=  ea:,a" +/■'■/.  (31) 

t 

Hence  where  7  >  1.  Since  EjA,,  ==  M,  we  have  Z).  A'.  --  so  we 

can  rescale  these  signal  vectors  by  forming  another  signal  set  s''  7s,.  Again  note  that 

52iS''  =  0,  A''  =  M.  The  normalized  distance  between  any  two  vectors  of  {s'/}  is 

efff  =  A^fAC-2A., 

=  7(A',  +  AC  -  2A.,) 

-  Jd'i 

=  idl 


where  the  last  equality  follows  by  our  earlier  remark.  Since  7  >  1,  d"  >  d,j  with  ecpiality 
if  and  only  if  dij  =  0.  Since  we  assumed  d^in  >  0,  d"j  >  dij  and  hence  >  d^m- 
which  is  a  contradiction.  This  proves  the  necessary  condition  52^  s,  0. 
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This  leads  to  the  theorem 

Theorem  3  —  The  regular  simplex,  signal  set  is  the.  unique  signal  set  that  mamnizes 
the  minimum  distance. 

Proof;  The  result  follows  immediately  from  Lemmas  2  and  3  and  from  Deiinition  1. 
This  result  leads  to  the  corollary 

Corollary  1  —  Given  A  >  0,  there  exist  signal  sets  that  maximize  the  minimum  dis¬ 
tance  between  signals  but  do  not  maximize  Pj. 

Proof:  The  result  follows  from  Theorem  3,  which  states  that  the  regular  simplex  is  the 
unique  signal  set  that  maximizes  dnun',  and  from  Proposition  I,  which  demonstrates  that 
the  regular  simplex  is  suboptimal  in  terms  of  P^. 

5.  OPTIMALITY 


In  this  section  we  address  the  optimality  of  signal  sets  in  terms  of  both  the  average 
probability  of  error  and  the  union  bound  on  that  probability.  The  union  l)ound  is  an 
often  used  fairly  tight  approximation  for  low  rates  [20,  p.  68]  or  relatively  high  SNRs 
when  computing  the  average  probability  of  error  is  intractable. 


Theorem  4  —  The  regular  simplex  uniquely  minimizes  the  union  bound. 


Proof:  The  union  bound  for  the  average  probability  of  error  of  tlie  ith  signal,  is 
expressed  as  [20,  p.  60] 


P. 


s  E  a, 

Jj/’ 


where  is  the  error  probability,  given  the  fth  signal  is  sent  and  the  jth  signal  is  the 
only  alternative.  The  average  probability  of  error  is  given  by 


A/ 


E  n.. 


The  union  bound  for  the  average  probability  of  error  is, 

2 


i  j^i 


«  »» 
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Now 

P..,  -  ■1>(-|^A) 

where  dij  is  the  normalized  Euclidean  distance  between  s,  and  fus  defined  in  Section 
4,  Hence, 

t  ^>1  ^ 

Let  u  =  (di2,d|3,--  •  ,dfM_i)Af)  where  we  include  all  dij,  i  /  j.  Let  f{n,)  24>(-^A) 

where  Uj  is  the  ith  element  of  u.  Hence  --  X  ^  /(ui)  vvhere  />  MOV.ril  is  the 
dimension  of  u.  Now  /(uj)  is  a  convex  U  function  on  the  interval  [O.oc)  since 


fix)  = 


A 


+ 


A' 


2exp[^j  expj^l  VoITtt  \/7 

for  all  X  >  0.  Hence  Jensen’s  inequality  applies: 


>  0, 


1  ^"1  4/  —  1  ^  1 

^  U:  1 


M 


(33) 


i  ;>t 


The  right-hand  side  of  Eq.  (33)  is  a  strictly  decreasing  function  of  2D,  2D;>,  dfj.  hetice  it 
reaches  its  minimum  value  whenever  is  maximum.  We  know  from  Lemma  3 

that  with  equality  if  and  only  if  dmm  -  By  Theorem  3  eqiuiiity 

is  achieved  uniquely  by  the  regular  simplex,  which  is  the  only  signal  set  that  minimizes 
the  right-hand  side  of  Eq.  (33).  Note  that  for  the  case  Jensen’s  inequality  is 

satisfied  with  equality  as  both  sides  become 


A/  -  1  2M 
2 


This  completes  the  proof. 


Corollary  2  —  There  exists  A  >  0  and  signal  sets  {s,}  and  {s'}  such  that 

whereas  Pe  >  Pi-  The  probabilities  of  error  and  union  hoxinds  for  the  signal  sets  {s,} 

and  (s'J  are  Pe,  PJ  and  Pj“D,  Pj“3  respectively. 


Proof:  Follows  from  proposition  Eq.  (1)  and  the  previous  theorem  with  (s, }  correspond¬ 
ing  to  the  simplex. 

We  now  will  examine  characteristics  of  optimal  signal  sets  at  low  SNH. 


Theorem  5  —  For  all  M  >  7,  the  optimal  solution  at  low  SNR  is  not  an  equal  energy 
.solution. 
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Proof:  A  necessary  condition  for  optirnality  is  that  the  mean  widtli  of  the  polytojx* 
Eq.  (12)  be  maximized  [6],  However,  it  was  .statetl  by  Ihilakrishnan  joj  that  the  resz;nlai 
simplex  maximizes  Eq.  (12)  among  all  equal  energy  signal  sets.  Since'  proposition  Eq. 
(1)  showed  that  the  L\  signal  set  is  better  than  the  regular  .simplex  for  all  M  >  7.  it  is 
certainly  better  than  all  equal  energy  codes  at  low  SNf{.  Hence,  the  optimal  solution  is 
not  an  equal  energy-  solution. 

Theorem  6  —  For  sufficienthj  small  A.  the  />!  sigrial  set  is  uniquely  optimal  in  the 
class  of  1-D  signal  sets  that  are  ax’crage.  power  constrained  i.c.,  satisfy  <  /'. 

Proof:  A  necessary  condition  for  oT)timality  is  again  that  the  mean  width  of  the  j)olyto|)«‘ 
Eq.  (12)  be  maximized.  For  signal  .sets  restricted  to  on<*  dimension  this  is  e(|uivalt'nt  to 
maximizing, 

01  ~  max  .Si  4  tmix  —  s,, 

t  ) 

--  max  .Si  -  min.s,.  (.‘M) 

t  I 

Since  detection  probability  can  be  shown  to  be  an  increasing  function  of  A  [7.  p.  (i2|  the 
solution  will  lie  on  the  boundary  A^  =-  P.  It  has  been  remarked  l)y  Dunbridge  and  can 
also  be  seen  by  Eq.  (12)  that  an  optimal  solution  must  have  signal  vectors  (dther  on  the 
boundary  of  the  convex  hull  generated  by  the  signal  vectors  or  else  at  the  origin.  Ih'nc<‘ 
three  possibilities  are  to  be  considered: 

Case  1:  {Sj}  =  0  for  f  ==  1,  •  •  • ,  A/  —  r;  and  -  Xi  >  0  (or  ecpiivalently  {.Sj} 

Ti  <  0)  for  j  =  A/  -  r  4-  1 ,  •  •  • ,  Af ; 

Case  2:  {si}  =  T]  >  0  and  {,Sj}  =  X2  >  Xi,  (or  ('quivalently  {.s,}  tj  <  0, 
{sj}  =  X2  <  xi  )  for  f  =  1 ,  •  •  • ,  A/  -  r  and  j  M  -  r  f  1 ,  •  •  ■ ,  A/; 

Case  3:  {si}  --  0  for  i  -  1 ,  •  -  ,  M  ~  r  -  p\  and  {.s_, }  .ri  <  0  for  j  M  -  r  -  p  \ 

1,  ■  •  ■ ,  Af  —  p;  and  {s>}  -  x^  >  0  for  h  -  A/  -  p  !  1 ,  •  •  • ,  A/. 

A  necessary  condition  for  oiUimalify  j(i|  is  that  (he  eonvx'x  hull  g'tierated  by  the 
.signal  vectors  contain  the  origin.  Hen<'<>.  (’use  2  is  immc'diately  flismissf'd.  If  is  seen  to 
be  maximized  in  Case  1  when  r  1  or  X|  Xy/JJ  resulting  in  If  Xy/JI.  However, 

the  Ll  code  of  Case  3  results  in  If  A\/2A/.  Hencxu  Case  1  is  dismissed.  It  (  an  he 

seen,  for  any  code  in  Case  3  with  r  >  1,  that  we  can  furth('r  deen'a.se  .;  i  by  rearranging 
r  -  1  signals  from  Xi  to  the  origin.  1'his  will  nvsult  in  an  imreas*'  in  If  x^  -  x,.  \\V 
can  increa.se  X2  if  P  >  E  Hence,  the  optimal  signal  set  belongs  to  {'a.s(’  3  and  is  such 
that  r  --  p  =:  1.  Now,  we  only  need  to  prove  that  .r,  -x^.  This  follows  directly  from 

the  Cauchy-Schwartz  inequality, 


15 


MICHAEL  J  STEINER 


H  r.s,  <  / /f  )(X^  si)  r,.  .s.  >  0, 

i  V  *  * 

Let  Sj  =  S2  -  Ti  -  Ti  >  0,  T'i  -  — T2  >  0  so  tiiat  tho  above  becomes, 

xi  -  X2  <  \j2{xi  f  xi) 

-  XVJKJ. 

where  equality  holds  if  and  only  if  {x,,-X2)^  is  a  multiple  of  to  (1.1).  'I  bis  will  occ  ur 
if  and  only  if  Xi  ■-  — X2  --  prerving  optimality  as  vvc'll  as  uniejueness. 

6.  CONCLUSIONS 

The  problem  of  optimal  signal  dc^sign  for  the  white  Gaussian  noise*  c-hannc'l  has  bec'p 
considered  to  be  a  fundamental  problem  for  many  years.  Wc>  have  exhibitc'd  a  counterex¬ 
ample  that  disproves  the  long-standing  strong-simplex  conjecture.  This  countc-rexamycle 
essentially  relies  on  the  tradeoffs  between  communication  rate  and  performance.  VV’hcm 
the  communication  rate  is  decreased  by  placing  A/  -  2  signals  at  tlie  origin,  wc*  can  place 
the  remaining  two  signals  at  a  relatively  large  distance  with  the  intemt  of  at  least  dis¬ 
criminating  between  these  two  signals.  At  low  signal-to-noise  ratios,  the  [)erforrnaric'e  is 
better  than  that  of  the  regular  simplex  for  which  the  distances  betwex-n  signal  vc-ctors  is 
smaller  than  the  distance  betwexm  the  two  signals  of  the  c'ountcTexamplc*.  'I  bis  differc>nc'c‘ 
counteracts  the  effect  that  the  high  probability  of  c-rror  of  the*  remaining  .U  -  2  signals 
has  on  the  performance  of  the  LI  signal  set. 

Tliis  result  in  conjunction  with  previou.s  work  Ic'd  to  sc-veral  llK'orc'ins  It  w;i.s  t-stab- 
lishecl  that  the  cjptimal  signal  set  is  indcx'cl  depc'udent  on  the  signal-) o-noi.<e  ratio  for  all 
M  >  7.  The  optimal  signal  sets  at  low  SNR  for  all  M  >  7  are  necc.ssanly  untsiual  energy 
signal  sets.  The  design  of  .signal  .sets,  under  the  cxiteria  of  maximi/ing  the  ttiimmtnn 
distance,  was  also  consirlered.  Past  results  that  c'stablishc'd  tliat  the  rc'gular  simph'x 
maximizes  the  minimum  distance  under  a  peak  powc'r  constraint  wexe  exiendc'd  to  the* 
case  of  only  an  average  power  c;onstraint.  This  Ic'd  to  the  corollary  tlial  signal  sets  that 
maximize  the  minimum  distance  necxl  not  maximize  the  probability  of  dc'tection.  We 
alsc3  proved  that  the  regular  simplex  optimizes  the;  union  bound.  In  general,  optimiza¬ 
tion  of  the  union  bound  does  rot  necessarily  indicate  maximization  of  probability  of 
detection.  Finally  the  LI  signal  set  was  shown  to  be  the  optimal  signal  set  constrainc'cl 
to  one  dimension. 
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The  determination  of  the  optimal  signal  sets,  which  maximize  the  probability  of 
detection,  remains  in  general  unsolved  for  low  SNR.  Perhaps  optimal  designs  can  be 
found  for  some  partition  of  the  SNR  range  |0,  oc)  as  a  function  of  A/,  d'he  weak  simplex 
conjecture  has  not  been  proven  and  the  optimal  design  under  a  noncoherent  assump¬ 
tion  remain  unsolved.  With  few  exceptions,  optimal  sigmil  designs  under  a  bandwidth 
constraint  remain  unknown. 
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Appendix  A 

REPRESENTATION  OF  INNER  PRODUCT  MATRIX 

We  prove  that  an  inner  product  matrix  unicjiu'ly  determines  a  signal  set  vi|)  to  an  isom¬ 
etry.  This  is  proven  for  complex  matrices;  although,  we  an'  only  inten'sted  in  real  inner 
product  matrices.  Let  C„  denote  th<*  set  of  all  by  n  complex  »".at  rices. 

Definition  2  —  Two  signal  sets  A  -  {si„  •  •  •  and  B  {s,;,  •  •  -  smi,}  are  isorneir'ie 

if  there  exists  a  hijective  transformation  T  :  A  ^  B.  called  an  isometry,  .■<ilcIi  that 

d{TSia,TSja)  =  d{s  ia '  Sjia  )  for  all  i,j  where.  d{x.  y)  is  the  Euclidean  distance  from  x  to  //. 

Suppose  that  A  and  B  are  two  signal  sets  of  A/  vectors.  Let  ti  he  tlie  tmeximum  of  the 

dimension  of  the  vectors  in  A  and  B.  Let  A  be  a  matrix  whose  columns  are  com))osed 

of  the  signal  vectors  of  the  first  signal  set,  and  B  the  matrix  whose  columns  are  the 
signal  vectors  of  the  second  signal  set.  Suppose  that  the  inatrix  of  inner  products 
corresponding  to  A  (i.e.,  A* A  where  *  denotes  the  liermitian  transpose  of  d)  is  the 
same  as  the  inner  product  matrix  corresponding  to  Id.  Embed  A  and  B  into  n  by  n 
matrices  A  and  B'  by  adding,  if  necessary,  zeroes  to  the  right  and  the  bottom  of  each 
matrix.  It  follows  from  Ref.  |15,  p.  411]  that  there  exists  a  unique  positive  semidefinite 
matrix  P  =  {A'* A)i  €  and  a  unitary  matrix  V'  e  C,,  such  tliat  A'  -  VP  [21  j. 
Similarly,  B'  ---  WP  (since  the  inner  product  matrix  A'* A'  is  the  satne  for  both  signal 
sets),  and  hence  A'  {V\V*)B'.  The  matrix  V\V*  is  unitary  and  unitary  matiTx's  are 
easily  shown  to  be  isometries.  The  additional  zero  columns  can  be  removed  from  A' 
and  B'  and  the  resulting  matrices  are  still  related  by  the  unitary  matrix  LTT*.  Since 
the  additional  rows  of  zeroes  are  inconsequential,  w'e  conclude  that  two  signal  sets  of  .1/ 
vectors  are  isometric  if  the  matrices  of  inner  products  A* A  and  B* B  arc  identical.  Not(' 
that  the  converse  is  not  necessarily  true,  since  an  inner  product  matrix  of  a  signal  set  o 
depends  on  the  ordering  of  the  columns  of  A. 


Appendix  B 

PROOF  OF  MONOTONICITY 


We  prove  that  Eq.  (22)  is  monotonically  decreasing  for  M  >  30.  Consider  the  first  term 
in  Eq.  (22) 


MM)  =  ■ 


It  is  easily  seen  that  the  derivative  of  /i  with  respect  to  M  is, 

-2-log(M-  1) 


f[{M)  =  vT- 


2(M  -  1)3 


Hence  f[{n)  <  0  whenever  log(A/  —  1)  >  2  or  A/  >  6.  Since  /i  is  a  continuous  function  of 
M,  the  first  term  is  a  monotonically  decreasing  function  of  M  for  M  >  6.  Next  consider 
the  second  term  in  Eq.  (22) 


/2(M)  = 


M 


{- 


v'2(M  -  1)  v'(M  -  1) 


-) 


<?  log(M-l) 


=  ^(( 


^((M-l)-^-V^  +  (M-l) 


y/M  -  1 

l-c^  log(M-l) 

*  )• 


lc>g(Af - 1)+ 1 


(35) 


To  analyze  f2{M)  examine  the  function 


S(M)  =  (M  -  l)”'"!, 


where  a{M)  is  any  differentiable  function  of  M.  The  derivative  of  g{M)  is 

A  sufficient  condition  for  g'{M)  <  0  for  any  M  >  2  is  a(M)  <  0  and  n'{M)  <  0. 
Therefore  a  sufficient  condition  for  the  first  term  of  J2{M)  to  have  a  derivative  that  is 
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negative  is  that  ^  c^iogCM  i)  ^  g  ^  g  Qf  these  conditions  are  satisfied 

fo^  M  >2.  The  sufficient  conditions  for  the  second  term  of  /2(M)  are  <  q 

and  <  0.  The  first  condition  is  satisfied  whenever  A/  >  7  for  qm)  .78  where 

Cm  is  defined  in  Eq.  (23).  The  second  condition  is  satisfied  for  M  >  2.  Thus,  the  second 
term  is  monotonically  decreasing  for  M  >  7.  In  conclusion  the  bound  in  Eq.  (22)  is 
monotonically  decreasing  for  all  M  >  30. 
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Appendix  C 

DERIVATION  OF  BOUNDS 


We  first  derive  an  upper  bound  of  r.  Normalizing  Eq.  (20)  by  dividing  through  by  Eq. 
(18)  we  have,  _ 

I  1  roo  , 

(36) 


r  < 

This  can  be  bounded  by 
r  <  M 


1 


^  y  exp[-^l4>^~‘(3^)da;  +  ^  y*  exp[— — ]4>^~‘(2:)da:  + 


2{M-  1) 

+  4y^exp[-^|«>^"‘(a:)da:  +  y  xexp[~^]dx 

This  can  be  integrated  yielding 


r  < 


TT 


M-  1 


_  4,M(o)|  +  |($«(|)  -  4.«(1)|  + 

,K  fv  rv  rv  tv 


+  4[$^(4)  -  $^(4^;^)] 

K 


+ 


M 


-  1) 


TT 


M-  1 


4  4 

4  ^ 


h/  ■ 


i=0 


exp  [-8] 

M 

MhTT) 


exp[— 8j. 


(37) 


We  now  derive  a  lower  bound  of  r.  Normalizing  Eq.  (19)  by  dividing  through  by  Eq. 
(18)  we  have  , 

r~  -7==  /  xexp[ — — ]5>^^“*(a:)dx. 

_  1 1  — oo  2 


V'2(M  -  1) 


This  is  lower  bounded  by, 
M 


r  > 


s/m  - 1) 


f  xexp[-”]‘i»^  - -05  f  exp[-^l<&'^  *(x)rfj 

J —OO  ^  J  —  .Q5  ^ 


-oo 

.2 


/— .00  T'*  r— .95  7** 

exp[-|-]<I>^-‘(a:)da: - J  ^  exp[~y]$'^-Ux)dx 

2  ^ 

f  X  exp[“-  ^  {x)dx , 

Jo  2 


+ 
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This  can  be  integrated  as 


■f  foo  /..2 

==  j  Texp[-~ 
5  _  1  Wo  2 


/2(M  ~  1 


Upon  substituting  g,  >  -— ^^=4)''^-'(-l)exp[-|j  - 


dniiy-is 

(A/-1)  1"^!" 


l)j  the  above  is. 


r  >  qi  -\ - ,.--.i=  f  Texp[-^-]T'''  ‘(jr)dj-, 

^{M  -  1)  ■'o  2  ‘ 


which  can  be  bounded  bv. 


r  >  (7i  + 


^2(M  -  1)  r/o’  I  //  -l-l- yH>*'- 

‘^—f.  /„>-„  exp|-L|j.‘»-'(i)rf3:  -I-  j>M-i(4)  icxp|-L|((x 


/2{M  -  1) 


This  reduces  to 


fi{Af)  =  qi  + 


(M-1)  [  ki 


T^^(4)  + 


A/exp|--8]<h''^-‘(4) 
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